Papers by Gaël de Léséleuc de Kérouara
Breaking Writer’s Block: Low-cost Fine-tuning of Natural Language Generation Models (2021.eacl-demos)
Copied to clipboard
| Challenge: | Currently, it is standard procedure to fine-tune large pre-trained language models for information extraction tasks, but this is not the case for generation tasks, which relies on a variety of techniques for controlled language generation. |
| Approach: | They propose a system that fine-tunes a natural language generation model for the problem of solving writer’s block. |
| Outcome: | The proposed system obtains excellent results even with a small number of epochs and a total cost of USD 150. |